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Abstract. Increasing amounts of spatial -temporal building deformation 
data now can be deri ved from SAR satel I ite i mage stacks usi ng tomographi c 
inversion techniques. Such huge amounts of 4-D information are crucial for 
monitoring building behavior as well as detecting potential damage. Build- 
ing deformation data, characterized by directional dependences, large dif- 
ferences in scale, and anisotropic uncertainties, pose a great challenge for 
visualization and analysis. Existing visualization techniques are anchored in 
point clouds, resulting in clusters of points which are often difficult to un- 
derstand and analyze for the public. I n this paper, we propose a visual ana- 
lytical method to handle the 4-D building deformation data, which allows 
the immediate perception of the overall deformation pattern and explora- 
tion of interesting areas based on a 3-D building model. The workflow 
mainly consists of the co- registration of the deformation data with 3-D fine 
building models, the aggregation and classification of deformation data and 
the user interface design process. We evaluate our method on the defor- 
mati on data of the Bel I agi o hotel area i n Las Vegas deri ved from TerraSAR- 
X data and 3-D building models from 3D warehouse. The preliminary case 
study demonstrates the feasi bi I ity of our approach. 
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1. Introduction 

I ncreasing amounts of spatial -temporal building deformation data now can 
be derived from SAR satellite image stacks using tomographic inversion 
techniques. These data areoften in the form of point clouds (e.g. range from 
a few million to several hundred million points) with motion information 



that reflects building dynamic behaviors in a certain time period. Such huge 
amounts of 4-D information are crucial for monitoring building behavior as 
well as detecting potential damage. However, deformation data characteris- 
tics, such as directional dependences (3-D motion) and large differences in 
scale (since the data sets may cover several kilometers in each direction, 
while the deformations are measured in millimeters per year) (Zhu, 2011), 
pose a great challenge for data visualization and analysis. 

In scientific visualization, point cloud visualization techniques are usually 
applied to represent extremely large amounts of remote sensing data. Sci- 
entif i c vi sual i zati on of remote sensi ng data al so i nvol ves processi ng steps to 
extract geometries, eg. building surfaces or model reconstruction from 
point clouds (Vosselman & Dijkman 2001Fabio 2003), which would not be 
in the scope of our research. Level of detail (LOD) techniques are normally 
employed to render point clouds efficiently, basically by selecting less num- 
ber of key points from point clusters and rendering them at a coarser level 
of detail (De La Calle et.al. 2011). The advantage of the method is that data 
accuracy could be kept. However, point cloud visualization has several limi- 
tations for massive building deformation data analysis: 

- Compared to GPS measurements, the biggest advantage of SAR de- 
formation measurements is the large coverage and detailed moni- 
tori ng that is reflected by the amount of poi nts we obtai ned for i ndi- 
vidual buildings. The idea of key points selection, however, would 
throw away useful information. 

- Without building model as a context, additional attributes associat- 
ed with the 3-D point clouds such as deformation information are 
not intuitively accessible for the public. Even when point clouds are 
fused with the building models, massive points could make the 
buildings invi si ble. 

Another way to represent building deformation is to aggregate deformation 
data to building surfaces of a given building model. Normally, a 3-D build- 
ing model at a specified level of detail could be constructed by softwares 
such as Trimble Sketchup (also well-known as Google Sketchup before), 
AutoCAD or Blender. Based on the 3-D building model, 3-D point clouds 
and their attributes could be associated to building surfaces. In computer 
graphics, texture mapping technique is widely used to add detail, surface 
texture or color to computer-generated graphic or 3D model. In cartog- 
raphy, enrichment of the building facades with thermal data could be found 
in Kumke (2011). Ding et al. (2012) presented some preliminary results of 
building deformation data visualization based on a simplified building 
model . 



Theabovementioned techniques of visualizing aggregated data can enhance 
the perception of the overall data distribution. However, the aggregated 
information becomes less suitable for analytical purposes. As for defor- 
mation data, a tradeoff is required to allow both the overview visualization 
of the building deformation and the analysis of the millimeter motion. 
Technologies from the new discipline visual analytics may provide promis- 
ing solutions. By enabling a proper combination of the analytical capacities 
of computer and the visual abilities of humans, these technologies can sup- 
port novel discoveries and empower individuals to take control of the ana- 
lytical process (Keim 2010). In Geoscience, geospatial visual analytics are 
applied to visualize and analyze large spatial -temporal data sets, such as 
movement data (Andrienko & Andrienko 2013). 

In this study, we propose a method for visualizing and analyzing massive 
building deformation data, which allows the immediate perception of the 
overall deformation pattern and the exploration of some interesting areas 
based on a3-D building model. This workflow mainly consists of the match- 
ing of deformation data with 3-D building models, the data aggregation and 
classification process and the user interface design process. Original point 
clouds serve as the raw data and are matched with 3-D building models. 
The matched data then are aggregated to regularly partitioned areas on 
building surfaces. The visualization can show building surfaces enriched 
with grid-based aggregated deformation. Detailed deformation inside each 
aggregated grid could be incrementally loaded and visualized using differ- 
ent visualization techniques, e.g. 2-D contour mapping, diagrams. Fur- 
thermore, temporal deformation changes could also be investigated. We 
evaluate our workflow on the deformation data of the Bel I agio hotel area in 
Las Vegas derived from TerraSAR-X data and 3-D building models from 3D 
warehouse. The preliminary case study demonstrates the feasibility of our 
approach. 



2. A Visual Analytics Method of 4-D Deformation Data 

This section briefly introduces our visual analytics workflow for building 
deformation data analysis. We treat the data processing procedure and the 
user interface design separately. 

The data processing step consists of the co- registration of the deformation 
data with the 3-D building models and the aggregation and classification of 
the deformation data. There are two main branches in this step as illustrat- 
ed i n Fi g. 1 The fi rst branch is from the raw deformati on poi nts to the gri d- 
based aggregated data. Points around the investigated building are extract- 
ed. The selected points that are originally recorded in the Universal Trans- 



verse M ercator (UTM) geographic coordi nate system are then transformed 
to the local coordinate system of the 3-D building models, projected and 
matched to the surfaces of the 3-D building model. Finally, the deformation 
measures of those poi nts are aggregated to the gri ds on the bui I di ng surfac- 
es. 

The second branch isfrom a 3-D building model with triangle primitives to 
a simplified 3-D building model with gridded surfaces. For simplifying the 
association of the deformation data to the building model, only geometries 
with large areas are selected. The selected triangle primitives, which are 
adjacent, are then aggregated to larger rectangles. Based on those rectan- 
gles, regularly spaced grids can be generated. 
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Figure 1 Data preprocessing steps. 

Fig. 2 shows the user interface design framework for deformation data 
analysis. The principle is that bui I ding surfaces are enriched with aggregat- 
ed deformation data, and interesting areas could be interactively selected. 
Deformation distribution inside the selected area is incrementally loaded 
and explored with different visualization techniques. In addition, temporal 
deformation series are taken into consideration, e.g. spatial deformation 
distribution of the building surfaces has been given a time stamp that 
evol ves al on g the ti me axi s. 
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Figure 2. The user interface design. 



3. Case Study 

3.1. Building Deformation Data 

The test data for this research consist of 131,402 points derived from D- 
TomoSAR in Las Vegas Bellagio hotel area (Zhu, 2011). The SAR images 
have an azimuth- range resolution of 11m x0.6m. Each point has a 3D (x, y, 
and z) coordinate and an associated deformation parameter, i.e. the ampli- 
tude of seasonal motion. The footprints of objects are recorded in the UTM 
coordinate system. Based on the original data set, the temporal deformation 
changes are simulated in 12 months. In Fig. 3, the left picture is the test 
area illustrated on GoogleEarth, and the right one shows the correspondi ng 
measured point clouds in this area. The heights z of the points are color- 
coded. 





I 



Figure 3. The left picture is an optical view of the Bellagio hotel test area in Las 
Vegas (Source: Google Earth). The right one is the test dataset (point clouds) in 
UTM coordinates (Color from blue to red showing the point heights from low to 
high). 



I n our case study, we extract points around the right building based on an 
approximate ground plan polygon. The color-coded point height and de- 
formation values are shown in Fig. 5. Point deformation values are actually 
measured in the I ine-of- sight direction of the satellite, which could reach an 
accuracy of well below millimeters per year. The range of deformation val- 
ues is about from -14 to 16 mm, with respect to a pre-selected reference 
poi nt. 




Figure 4. The selected points from the study area (Left). Color-coded deformation 
attributed to the points (Right). 

3.2. 3-D Building Model 

The 3-D building model we used is obtained from Trimble 3-D warehouse. 
Fig. 5 shows the 3-D models of the study area that includes 2 main build- 
ings. 




Figure 5. The study area. (Source: Trimble3-D warehouse 1 ) 



We sel ect the ri ght bui I di ng as our test bui I di ng. I ts bui I di ng model consi sts 
of 402 triangle primitives (Fig.6 (1)). To simplify the model, weselecttrian- 



http:/ / sketchup.googl acorn/ 3dwarehous^ detai I s?mi d ^943bc4b50e0656Ilc8c59bc53bd59 
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gles (76 out of 402) that have relatively larger areas and angles (Fig.6 (2)). 
For the conveni ence of generati ng regul ar gri ds, we aggregate tri angl es with 
the same normal and sharing common edges to rectangles (Fig.6 (3)). 
Based on the rectangles, we partition the selected building surfaces (walls 
and roofs) into regularly spaced grids (Fig.6 (4)). 
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Figure 6. Building models. From left to right: (1) triangle primitives; (2) selected 
triangles; (3) aggregated rectangles; (4) grid partitions. 

3.3. Deformation Aggregation and Classification 

The selected points around the building in Fig. 4 are firstly transformed to 
the local coordinate system of the building model and then projected onto 
the building surfaces as shown in Fig. 7. 




Figure 7. Projected points on the building surfaces. 

For easy understanding of the deformation pattern, we aggregate the 
individual points into grids. To make deformation aggregation more 
reliable, we use the inverse of distance from points to building surface as 
weights. The aggregated deformation value in a grid G t is calculated as 
follows: 



T.proj(p)eG t d (p,G:)+E .... 
Vc t = 1 — (-U 

where v G . is the aggregated deformation value of grid G { ; given a pointp, 
proj(p) is its projection on the building surface; d(p, G{) is its distance to 
the plane of grid G^; £ isasmall positive quantity. 

To make the visualization result quickly accessible for the users, we group 
similar aggregated deformation data to fewer classes and further assign the 
same symbol to each member of the class. To compare deformation features 
with some specific, meaningful deformation values, we manually classify 
the data by altering the class breaks. According to choropleth mapping 
principles, the aggregated deformation data are grouped into 7 classes (Slo- 
cum 2009). However, how class ranges and breaks are defined largely de- 
termines the appearance of the visualization results; see more discussion in 
section 4. 

3.4. User interface Design 

Following the user interface design principles in the workflow, we imple- 
ment the user i nterface and analyze deformation data as shown in Fig. 8. 
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Figure 8. A screenshot from the interactive user interface. 

The left window of the user interface shows the deformation distribution of 
the whole building. I n this case study, we assume that the building height 
deforms either downwards or upwards. The chosen color scheme for grid- 



based aggregated data isfrom blue to red, which is commonly used in visu- 
alization of terrain deformation data: blue indicates deforming downwards 
and red indicates upwards. The legend shows the values of the 7 classes of 
the aggregated deformation. 

Spatial uncertainties are introduced into the aggregated deformation data. 
Detailed analysis is needed to evaluate the reliability of the results. In this 
case study, when we select a specific grid on the surface (shown in Fig. 8 
with a small black square on the front fagade), the windows on the right 
show the grid characteristics: 

- The dots represent the projected points falling inside the grid (upper 
wi ndow) . Thei r si zes i ndi cate the spati al uncertai nti es of the poi nts. 
The corresponding points of the larger dots are closer to the grid, 
and are more reliable. The background fi Ned-contour map, which is 
created by interpolating the deformation amplitude of the projected 
points, shows the variation of deformation amplitude inside. 

- The histogram of the relevant poi nts shows the dynamic range of the 
deformation parameters (middle window). I n this example, the am- 
plitude of seasonal motion for the selected poi nts are in the order of 
0~3mm and most of them undergo motion with amplitude of 1mm. 

- Temporal deformation changes are essential for the investigation of 
the building deformation behavior. In Fig. 8, a time slider is used to 
show dynamic building deformation in one year. In addition, a dia- 
gram (lower window) shows the seasonal deformation behaviors of 
the gri d i n the I ast 12 months. 



4. Discussion 

From the left part of Fig. 8 we can easily perceive the deformation distribu- 
tion on the building surfaces. The whole pattern shows that the building 
deforms downwards on the left part and upwards on the right. There could 
be a lot of reasons inducing this phenomenon. For example, the orientation 
of the whol e bui I di ng may pi ay an i important rol e. Si nee the mai n I ong axi s 
of the building runs North-South, the right or south part of the building is 
facing towards the sun and the left or north part does not get enough sun- 
shine for all days and seasons. A hypothesis could be that building orienta- 
tions andsunshineaffectaloton building deformation patterns. 

Another pattern shows that building boundaries or corners deform larger 
than inner building surfaces and there are obvious deformation structure 
lines on the surfaces. Fig. 9 is an illustration of the boundary lines between 
different deformation parts symbolized with different colors. A hypothesis 
is that building surfaces may split along those deformation structure lines. 



However, the appearance of deformation structure lines are largely 
dependent on classification methods. Thus, classification methods should 
be carefully chosen depending on requirements of different applications. 



Figure 9. The illustration of deformation structure lines. The visualization result 
largely depends on data classification. 

5. Conclusion and Outlook 

I n this paper, we introduced a visual analytical framework for the interac- 
tive analysis of massive bui Idi ng deformation data. The workflow consists of 
the co- registration of the deformation data with the 3-D building models, 
deformation data aggregation and classification, and the user interface de- 
sign process. In our case study, we use the enriched building surfaces with 
aggregated deformation data to show the overall deformation distribution. 
Spatial variation inside specific areas is visualized and detailed data can be 
explored when users select the corresponding grid. This visualization meth- 
odology could largely reduce users' cognitive efforts by generalizing large 
amounts of data, while keeping data accuracy by incrementally loading de- 
tailed data on demand. 

We will extend the developed visualization framework in order to under- 
stand the building deformation mechanism. In this paper, building models 
from Trimble 3-D warehouse do not include building semantic information. 
Deformation data are aggregated to regular grids on building surfaces. If 
more detailed building models with semantic attributes are available, e.g. 
CityGML building model, building information model (BIM), then we can 
aggregate our deformation based on building components, e.g. doors or 
windows. This would allow us to analyze the physical mechanism based on 
the measured building deformation data. Moreover, user tests will be con- 
ducted to esti mate the usabi I ity of our user i nterface. 
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